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Shortcomings of approaches to classifying psychopathology based on expert consensus have given rise to contemporary efforts to classify psycho¬ 
pathology quantitatively. In this paper, we review progress in achieving a quantitative and empirical classification of psychopathology. A substan¬ 
tial empirical literature indicates that psychopathology is generally more dimensional than categorical. When the discreteness versus continuity of 
psychopathology is treated as a research question, as opposed to being decided as a matter of tradition, the evidence clearly supports the hypothesis 
of continuity. In addition, a related body of literature shows how psychopathology dimensions can be arranged in a hierarchy, ranging from very 
broad "spectrum level" dimensions, to specific and narrow clusters of symptoms. In this way, a quantitative approach solves the “problem of co¬ 
morbidity” by explicitly modeling patterns of co-occurrence among signs and symptoms within a detailed and variegated hierarchy of dimension¬ 
al concepts with direct clinical utility. Indeed, extensive evidence pertaining to the dimensional and. hierarchical structure of psychopathology has 
led to the formation of the Hierarchical Taxonomy of Psychopathology (HiTOP) Consortium. This is a group of 70 investigators working together 
to study empirical classification of psychopathology. In this paper, we describe the aims and current foci of the HiTOP Consortium. These aims 
pertain to continued research on the empirical organization of psychopathology; the connection between personality and psychopathology; the 
utility of empirically based psychopathology constructs in both research and the clinic; and the development of novel and comprehensive models 
and corresponding assessment instruments for psychopathology constructs derived from an empirical approach. 

Keywords: Psychopathology, mental disorder, personality, nosology, classification, dimensions, clinical utility, Hierarchical Taxonomy of Psy¬ 
chopathology, ICD, DSM, RDoC 

(World Psychiatry 2018;17:282-293) 

Throughout the history of psychiatric 
classification, two approaches have been 
taken to delineating the nature of specific 
psychopathologies 1 . A first one might be 
termed authoritative: experts gather un¬ 
der the auspices of official bodies, and 
delineate classificatory rubrics through 
group discussions and associated polit¬ 
ical processes. This approach character¬ 
izes official nosologies, such as the DSM 


and the ICD. It also often characterizes 
official efforts to influence the constructs 
and conceptualizations that frame the 
perspectives of funding bodies. For ex¬ 
ample, the US National Institute of Men¬ 
tal Health’s Research Domain Criteria 
(RDoC) effort involved the delineation 
of constructs that were shaped and or¬ 
ganized by panels of experts 2 . 

A second approach might be termed 


empirical. In this approach, data are 
gathered on psychopathological build¬ 
ing blocks. These data are then anal¬ 
yzed to address specific research ques¬ 
tions. For example, does a specific list of 
symptoms delineate a single psycho- 
pathological entity or, by contrast, do 
those symptoms delineate multiple en¬ 
tities? This approach is sometimes char¬ 
acterized as more "bottom up", compared 
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with the more "top down” approach of of¬ 
ficial nosologies. This is because the ap¬ 
proach generally starts with basic obser¬ 
vations and works to assemble them into 
classificatory mbrics, rather than work¬ 
ing from a set of assumed rubrics to fill in 
the detailed features of those rubrics. 

Obviously, these approaches, although 
distinguishable, are not entirely separa¬ 
ble. Authoritative classification approaches 
have relied on specific types of empiri¬ 
cism as part of their construction process, 
and an empirical approach begins with 
the expertise needed to assemble and 
assess specific psychopathological build¬ 
ing blocks (e.g., signs and symptoms). 
Nevertheless, it is clear that authoritative 
approaches tend to weigh putative ex¬ 
pertise, disciplinary background, and tra¬ 
dition heavily. 

To pick a specific example, the con¬ 
struction of DSM-5 was primarily a psy¬ 
chiatric endeavor, by virtue of the disci¬ 
plinary background of most participants 
and by the nature of the body that served 
to generate and publish the manual (i.e., 
the American Psychiatric Association). As 
part of the DSM-5 construction process, 
field trials were undertaken to evaluate 
the reliability of specific mental disorder 
diagnoses. Interestingly, these trials pro¬ 
duced a wide range of reliability esti¬ 
mates, encompassing evidence of weak 
reliability for many common diagnostic 
entities, such as major depressive dis¬ 
order and generalized anxiety disorder 3 . 
In spite of questionable reliability, these 
constmcts remain enshrined in DSM-5 
and constitute the official “diagnostic cri¬ 
teria and codes” in Section II of the manual. 

Because of these types of sociopolitical 
dynamics (e.g., asserting the existence of 
specific psychopathological categories ex 
cathedra despite questionable evidence), 
authoritative approaches have come un¬ 
der increased scrutiny. Many types and 
sources of scrutiny coalesce around the 
scientific disappointments that have ac¬ 
companied research on diagnostic cat¬ 
egories. Simply put, the categories of of¬ 
ficial nosologies have not provided com¬ 
pelling guidance in the search for eti¬ 
ology and pathophysiology. As a result, 
the empirical approach to classification 


is now attracting great interest as a po¬ 
tential alternative to diagnosis by pre¬ 
sumed authority and fiat. 

In the present paper, we summarize 
some key types of evidence that have 
emerged from the burgeoning literature 
on empirical approaches to psychiatric 
classification. We focus in particular on: 
a) evidence pertaining to the continuous 
versus discrete nature of psychopatho¬ 
logical constructs; b) evidence for the hi¬ 
erarchical organizational structure of psy¬ 
chopathological constructs; and c) evi¬ 
dence for specific empirically-based or¬ 
ganizational rubrics. 

In our discussion of specific empirical¬ 
ly-based organizational rubrics, we focus 
on a consortium that has recently formed 
to organize and catalyze empirical re¬ 
search on psychopathology, the Hier¬ 
archical Taxonomy of Psychopathology 
(HiTOP) Consortium. As we discuss the 
work of this consortium, we consider 
major issues that confront an empirical 
approach to classification, as it contin¬ 
ues to evolve. These issues correspond 
to existing workgroups in the consor¬ 
tium, and hence, we use the foci of those 
workgroups to organize our discussion. 

Specifically, those workgroups and our 
discussion are organized around: a) con¬ 
tinued research on the organization of 
broad spectra of psychopathology; b) the 
connection between personality and psy¬ 
chopathology; c) the utility of constmcts 
derived from an empirical approach (e.g., 
the ability of these constructs to organize 
research on pathophysiology); d) trans¬ 
lation of empirical research into clinical 
practice; e) the development of novel and 
comprehensive models and correspond¬ 
ing assessment instmments for constmcts 
derived from an empirical approach. 

THE CONTINUOUS VS. 

DISCRETE NATURE OF 

PSYCHOPATHOLOGICAL 

PHENOTYPES 

Perhaps the most fundamental dif¬ 
ference between current authoritative psy¬ 
chiatric nosologies and empirical research 
on psychopathology classification per¬ 


tains to the continuous vs. discrete nature 
of constructs. Through tradition and pu¬ 
tative authority, authoritative nosologies 
claim that psychopathologies are organ¬ 
ized into discrete diagnostic entities. By 
contrast, an empirical approach to classi¬ 
fication treats the discrete vs. continuous 
nature of psychopathology as a research 
question 4 . When treated as a research ques¬ 
tion, evidence points toward the general¬ 
ly continuous nature of psychopathologi¬ 
cal variation. 


Taxometric evidence 

Taxometric methods originated in the 
writings of P. Meehl, and evaluate the 
possibility that a set of symptoms (or oth¬ 
er indicators of psychopathology) delin¬ 
eate a discrete group. These methods 
have been used extensively, such that there 
is now a considerable literature on their ap¬ 
plication. This literature was summarized 
quantitatively by Haslam et al 5 . Based on 
findings from 177 articles, encompassing 
data from over half a million research 
participants, psychopathological variation 
was found to be continuous as opposed to 
discrete, i.e., there was little consistent evi¬ 
dence for taxa. 

Subsequent taxometric reports in di¬ 
verse areas also tend to reveal greater 
evidence for continuity as opposed to 
discreteness. For example, recent taxo¬ 
metric investigations have provided evi¬ 
dence for the continuity of subclinical 
paranoia and paranoid delusions 6 , ado¬ 
lescent substance use 7 , and depression 
in youth 8 . Occasional evidence for po¬ 
tential discreteness is also reported 9 ' 10 , 
emphasizing the importance of ongoing 
quantitative summaries of this literature. 

Psychometric studies of putative taxa 
are important to establish their validity, 
such as evaluating stability over time. 
That is, longitudinal stability of putative 
taxon membership is also a key means 
of evaluating a taxonic conjecture, inas¬ 
much as psychopathology taxon mem¬ 
bership is conceptualized as a stable prop¬ 
erty over modest time intervals (e.g., 
weeks or months). For example, Waller 
and Ross 11 reported evidence that patho- 
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Figure 1 Illustration of hypothetical data compatible with fully continuous and partially discrete models of psychopathological variation. In 
Panel A, the data points are generally well captured by positing a single group, in which Factor 1 and Factor 2 are positively correlated. In 
Panel B, the data are better captured by positing two groups, one in which Factor 1 and Factor 2 are positively correlated (the circles), and a sec¬ 
ond smaller group in which Factor 1 and Factor 2 are weakly negatively correlated (the triangles). 


logical dissociation might be taxonic. 
Watson 12 investigated this putative taxon 
and found that taxon membership was 
not stable across a two-month interval, 
whereas continuous indicators of disso¬ 
ciation were strongly stable. 

In sum, extensive evidence suggests 
that the likelihood of identifying discrete 
psychopathology groups empirically via 
taxometrics is not high. By contrast, the 
taxometrics literature generally points to 
the continuity of psychopathological var¬ 
iation, emphasizing the greater relative 
utility and empirical accuracy of continu¬ 
ous as opposed to discrete conceptual¬ 
izations of psychopathology. 

Model-based evidence 

Taxometric procedures originally e- 
volved to some extent outside of the 
mainstream statistical literature. Within 
the more mainstream literature, ap¬ 
proaches have emerged that rely on the 
ability to fit models to raw data on symp¬ 
tom patterns, and to use all of the exten¬ 
sive information in those data to adjudi¬ 
cate between continuous, discrete and 
hybrid accounts of psychopathology con¬ 
structs. These approaches are often termed 
model-based, because they rely on formal 


statistical models that describe the distri¬ 
butional form of the constructs that un¬ 
derlie symptoms. 

Generally, direct comparison of con¬ 
tinuous and discrete models via these 
approaches have indicated that psycho¬ 
pathological constructs tend to be more 
continuous than discrete 13 " 19 . Neverthe¬ 
less, there are also occasional sugges¬ 
tions of potentially meaningful discon¬ 
tinuities, particularly as conceptualized 
in models that have both continuous and 
discrete features 20 ' 22 . 

For example, Figure 1 depicts a bi¬ 
variate distribution similar to the results 
found in Forbes et al 20 . Panel A shows a 
sample where the two continuous fac¬ 
tors are moderately correlated for all par¬ 
ticipants (i.e., all participants are drawn 
from a single underlying population, akin 
to the results Forbes et al found for the 
relationships among depression, anxiety 
and sexual dysfunctions for women). In 
contrast, Panel B shows a discontinuity in 
the data where two groups emerge: the 
majority of the sample has a strong posi¬ 
tive correlation between the factors, but a 
subgroup of the sample has a weak neg¬ 
ative correlation (i.e., participants are 
drawn from two distinct underlying pop¬ 
ulations, akin to the results Forbes et al 
found for men). Generally speaking, the 


development and comparison of models 
of latent structure remains a profitable 
and active area of inquiry, because this 
approach provides an empirical means 
of directly comparing and potentially in¬ 
tegrating categorical and continuous con¬ 
ceptions of psychopathology 23,24 . 

However, similar to the situation with 
potential taxa, the discontinuities need 
to map truly discrete features of psycho¬ 
pathology (i.e., be reliable and replica¬ 
ble) to be meaningful. Consider, for ex¬ 
ample, how these requirements played 
out in a project reported by Eaton et al 25 . 
In this project, model based clustering 
was used to discern potential discrete per¬ 
sonality disorder groups. This approach 
works well in a variety of scientific areas, 
when there are actual discontinuities to 
be detected (e.g., character recognition, 
tissue segmentation; see http://www.stat 
washington.edu/mclust/ ). Eaton et al there¬ 
fore applied this approach to a large data 
set (N=8,690) containing samples from 
four distinguishable populations (clinical, 
college, community and military partici¬ 
pants). Potential discontinuities observed 
in each sample were not replicated across 
samples. By contrast, a dimensional model 
of the data was readily replicated across 
the samples. The authors interpreted these 
findings as suggesting that personality dis- 
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order features did not delineate replicable 
discontinuities, but instead, represented 
replicable continuities. 

In sum, efforts to identify potential dis¬ 
continuities on the basis of data are im¬ 
portant endeavors, because they continue 
to expose dimensional conjectures to risky 
and direct tests. Nevertheless, similar to 
what has been learned from decades of 
taxometric research, the bulk of the exist¬ 
ing model-based evidence points to the 
dimensional nature of psychopathology. 

Implications of dimensionality 

Evidence to date, stemming from mul¬ 
tiple empirical approaches, generally 
points to the continuity of psychopatho- 
logical phenotypes. As a result, contem¬ 
porary empirical approaches often con¬ 
ceptualize psychopathological constructs 
as dimensional, which has a number of 
implications. For example, it highlights 
the extent to which the categories of offi¬ 
cial nosologies are out of sync with data 
on the dimensional nature of psycho¬ 
pathology. This disparity is well recog¬ 
nized, and also, very challenging to navi¬ 
gate in a sociopolitical sense, because so 
many professional endeavors are firmly 
intertwined with the category labels en¬ 
shrined in official nosologies 26 . In this 
paper, we do not detail specific events 
that have recently played out surround¬ 
ing this challenge (e.g., pertaining to 
DSM-5 and ICD-11), but we do note that 
the challenge needs to be faced head-on 
if official nosologies aim to be founded 
on solid empirical footing 27 . 

We also note here another key impli¬ 
cation of the dimensional nature of psy¬ 
chopathology, pertaining to relations be¬ 
tween manifest psychopathology and its 
correlates. Specifically, the continuous 
nature of psychopathological variation 
provides a framework for understanding 
the form and nature of relations between 
cumulative risk factors, manifest psycho¬ 
pathology, and important outcomes 28 . 
Consider distal and putatively etiologic 
correlates, such as specific genetic and 
environmental risk factors. Continuous 
phenotypic variation suggests (but does 
not prove) that the relevant etiologic 


elements are likely multiple and numer¬ 
ous. Multiple relatively independent causes 
give rise to continuous phenotypic vari¬ 
ation, as is observed with many human 
phenotypes, e.g. height 29,30 . Similar to 
physical phenotypes, psychopathological 
phenotypes are likely the result of specif¬ 
ic mixtures of numerous etiologic influ¬ 
ences, with both proportions of influence 
and the resulting phenotypes varying 
continuously across persons 31 . 

In sum, the concept of continuous var¬ 
iation among persons in etiologic mixture 
dovetails well with the observation of con¬ 
tinuous phenotypic variation, and provides 
generative strategies for etiologic research. 
For example, persons with similar pheno¬ 
typic values may have arrived at those 
values in distinct ways. Hence, profitable 
research strategies might focus less on 
“cases” and "controls”, and more on de¬ 
veloping multivariate models of the joint 
distribution of etiologic (e.g., genomic 
polymorphisms) and continuous pheno¬ 
typic observations in larger samples 32 . 

Turning from causes to consequences, 
thinking about continuous variation and 
the public health consequences of psy¬ 
chopathology may also provide novel in¬ 
sights. Although psychopathology appears 
to be a continuous predictor, the nature of 
its relationship with public health conse¬ 
quences could take numerous forms, at 
least in theory. Thinking about this situ¬ 
ation may provide insights that go well 
beyond an artificial "cases vs. controls” re¬ 
search strategy. For example, continuous 
psychopathology may very well show a 
monotonically-increasing and generally 
linear relationship with impairment 33,34 . 
Or, the relationship could have non-lin¬ 
ear features, e.g., accelerating in a certain 
region of continuous psychopathological 

. . 99 ^ 

variation ' . 

Again, the key point here is that these 
possibilities are empirically tractable when 
psychopathology is modeled dimension- 
ally, yet obscured through the artificial 
dichotomization that characterizes tradi¬ 
tional psychiatric nosologies. Somewhat 
ironically, continuous measurement of 
psychopathology is essential to evaluat¬ 
ing the possibility that there are mean¬ 
ingful thresholds, beyond which social 


and occupational dysfunction becomes 
increasingly more likely. 

HIERARCHICAL 

ORGANIZATIONAL STRUCTURE 
OF PSYCHOPATHOLOGICAL 
DIMENSIONS 

One perennial issue in developing an 
empirically-derived and dimensional ap¬ 
proach to psychopathology pertains to 
general organizing principles. In tradi¬ 
tional authoritative and categorical ap¬ 
proaches to classification, this issue is 
tacitly addressed by the organizational 
structure of the classificatory effort. For 
example, the specific workgroup struc¬ 
ture of the DSM-5 construction effort im¬ 
plies an organization of psychopathology 
into rubrics that reflect the workgroup 
names, and that structure trickles down 
into the chapter structure of the printed 
classification. 

Might organizational issues also be ad¬ 
dressed empirically? Evidence described 
in the foregoing section stems from ask¬ 
ing if a specific set of signs and symptoms 
delineates a specific dimension as op¬ 
posed to a specific category. This evidence 
suggests that psychopathology is general¬ 
ly dimensional in nature, but how many 
dimensions are there, and how are these 
dimensions organized? 

Work in this area has generally pro¬ 
gressed from asking “what is the cor¬ 
rect number of dimensions” to realizing 
that this question is somewhat specious, 
because individual difference dimensions 
(e.g., individual differences in the pro¬ 
pensity to experience specific psycho¬ 
pathological signs and symptoms) are or¬ 
ganized hierarchically. This understand¬ 
ing has been important in resolving a var¬ 
iety of classificatory conundrums, typi¬ 
cally focused in areas where two or more 
psychopathological constructs contain 
variation that is both shared and unique. 

Perhaps the most classic example per¬ 
tains to anxiety and depression 36 . The 
tendency to experience pathological anx¬ 
iety is clearly correlated with the ten¬ 
dency to experience pathological de¬ 
pression, yet these tendencies are also 
distinguishable. Categorical nosologies 
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have difficulty managing these situations, 
because they tend to lead to proposals 
of "mixed categories" (e.g., a category 
of mixed anxiety and depression that 
is putatively distinguishable from a cat¬ 
egory of anxiety only and a category of 
depression only). If anxiety and depres¬ 
sion are more dimensional than categor¬ 
ical, as well as correlated but not perfectly 
correlated, then most patients will not fit 
neatly into any of these three categories. 
This tends to lead to difficulties making 
categorical diagnostic determinations in 
practice. For example, a mixed anxiety- 
depression category was proposed for 
DSM-5, but did not emerge from the 
field trials as a reliable diagnosis 37 . 

The key to resolving these sorts of di¬ 
lemmas is to realize that the evidence is 
most readily compatible with conceptu¬ 
alizing anxiety and depressive phenom¬ 
ena (as well as other dimensional phe¬ 
nomena) as encompassed by hierarchi¬ 
cally organized dimensions. To illustrate 
this point concretely, consider a model 
developed by Waszczuk et al 38 , portrayed 
in Figure 2. This model, which is based 
on extensive data, shows how specific 
anxiety and depressive phenomena are 
associated with continuous degrees of 
similarity and distinctiveness, across four 
hierarchically arranged levels of generali¬ 
ty vs. specificity. These hierarchical levels 
reflect the overall degree of empirical co¬ 
occurrence vs. distinctiveness of the phe¬ 
nomena encompassed by the model. Con¬ 
cepts higher in the figure are more general 
and broad, whereas concepts lower in the 
figure are more specific and narrow. 

At the most general level, diverse anx¬ 
ious and depressive phenomena are un¬ 
derstood to be aspects of a general do¬ 
main of internalizing psychopathology. 
Flowever, as is apparent in both data and 
clinical work in this area, although anx¬ 
ious and depressive phenomena are in¬ 
deed correlated, they are not perfectly 
correlated and, therefore, are distinguish¬ 
able from one another. Flence, one level 
down, distinctions emerge among distress, 
fear, and obsessive-compulsive (OCD)/ 
manic phenomena. Note that this is a 
more refined and empirically based un¬ 
derstanding when compared with DSM 
chapter headings, because, rather than 


being delineated by individual commit¬ 
tees, this model uses data to encompass 
the breadth of phenomena that fall into 
the internalizing domain. 

Accordingly, at a third level of specif¬ 
icity, key distinctions emerge among as¬ 
pects of the three distress, fear and OCD/ 
mania domains. OCD and mania are dis¬ 
tinguishable at this level, as are specific 
aspects of these broader domains, such 
as the cognitive and vegetative aspects 
of depression. Indeed, considered across 
levels, these patterns have fundamental 
conceptual and clinical implications. For 
example, these patterns highlight the con¬ 
nection between OCD and manic phe¬ 
nomena, as well as their distinctiveness 
from distress and fear. This may be trace¬ 
able to the connection that OCD and man¬ 
ic phenomena share with the broad spec¬ 
trum of psychosis, and how this psychotic 
aspect both drives OCD and mania to¬ 
gether, and separates them from other 
parts of the internalizing spectrum 39 . Fi¬ 
nally, at the lowest level of the hierarchy 
lie specific symptom clusters, such as 
checking, lassitude, and so on. 

In sum, the Figure 2 model solves the 
problem of "comorbidity between anx¬ 
iety and depression” by using data to 
model the empirical organization of emo¬ 
tional disorder phenomena. Rather than 
forcing these phenomena into commit¬ 
tee-derived categories, they are mod¬ 
eled as they are in nature. As a result, 
“complex presentations" (e.g., persons 
who present with a mix of emotional dis¬ 
order symptoms) are handled because 
these presentations can be readily repre¬ 
sented by a specific profile of problems. 
This understanding then drives case con¬ 
ceptualization in the clinic 40 , and strat¬ 
egies for identifying key correlates (e.g., 
neural response) in the laboratory 41 . 

Evidence for dimensional hierarchies 
can be found throughout psychopathol¬ 
ogy, and is not limited to anxiety and 
mood phenomena. Indeed, this evidence 
is sufficiendy comprehensive that it has 
formed the basis for a consortium of re¬ 
searchers interested in empirical ap¬ 
proaches to psychopathology, the HiTOP 
Consortium 42 . We turn now to describe 
the main features of the model that frames 
HiTOP, as well as the issues and topics 


that are currently being pursued within 
HiTOP. 


EVIDENCE FOR SPECIFIC 
EMPIRICALLY-BASED 
ORGANIZATIONAL RUBRICS 

Given evidence that psychopathologi- 
cal phenotypes are dimensional in na¬ 
ture, and that these dimensions are or¬ 
ganized hierarchically, what types of clas- 
sificatory rubrics emerge in an empirical 
hierarchy of psychopathological dimen¬ 
sions? The HiTOP Consortium focuses on 
these and related issues. 

The consortium currently consists of 
70 investigators with backgrounds in di¬ 
verse disciplines (e.g., psychology, psychi¬ 
atry and philosophy), and this group has 
proposed a working dimensional and 
hierarchical model, derived from the 
literature on empirical psychopathology 
classification. This model is portrayed in 
Figure 3. 

The model is not intended to be the 
final word on empirical psychopathology 
classification. Indeed, the purpose of 
articulating this model was to provide a 
first draft that might frame continued 
inquiry, and thereby move discourse 
away from tendentious debates about 
various reified classification schemes. 
Nevertheless, the model does summar¬ 
ize a substantial literature, reviewed by 
Kotov et al 43 as background for the hier¬ 
archical structure portrayed in Figure 3. 
Here, we will briefly outline the main 
features of the model, and then turn to 
discuss various workgroups within the 
consortium, which formed to address 
major issues in the field of empirical 
psychopathology classification. 

As portrayed in Figure 3, the working 
HiTOP model is hierarchical in nature. 
Constructs higher in the figure summar¬ 
ize the tendencies for constructs lower 
in the figure to co-occur in specific pat¬ 
terns. For example, consistent with Fig¬ 
ure 2, the broad internalizing spectrum 
in Figure 3 encompasses more specific 
“sub-spectra” such as the fear, distress 
and mania spectra. However, the model 
in Figure 3 was intended to synthesize 
the entire available literature on empiri- 
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the figure are narrower and more specific (adapted from Kotov et al 43 ). SAD - separation anxiety disorder, OCD - obsessive-compulsive disorder, MDD - major depressive disorder, 
GAD - generalized anxiety disorder, PTSD - post-traumatic stress disorder, PD - personality disorder, ODD - oppositional defiant disorder, ADHD - attention-deficit/hyperactivity dis¬ 
order, IED - intermittent explosive disorder. 

















































































cal classification and, as a result, its scope 
and breath is considerably larger than 
the Figure 2 model, which was designed 
specifically to delineate the internalizing 
spectrum. 

Consider spectra adjacent to intern¬ 
alizing in the Figure 3 model. In ad¬ 
dition to the internalizing spectrum, five 
other major empirical divisions of psy¬ 
chopathology are portrayed on the same 
level. Currently, the model posits major 
spectra labeled somatoform, thought dis¬ 
order, detachment, disinhihited external¬ 
izing and antagonistic externalizing. These 
concepts are reminiscent of, but not ne¬ 
cessarily coterminous with, similar con¬ 
structs in existing authoritative nosologies 
such as the DSM and ICD. For example, 
the current HiTOP model posits the ex¬ 
istence of a somatoform spectrum that is 
separable from other major psychopa¬ 
thology spectra, and roughly similar in con¬ 
tent to somatoform diagnoses in DSM-5. 

While the evidence for the somato¬ 
form spectrum is limited (as indicated 
by the dashed lines in Figure 3), this 
spectrum illustrates a general principle 
of empirical classification research. Phe¬ 
nomena that are not explicitly consid¬ 
ered within a specific scope can be con¬ 
sidered by expanding that scope accord¬ 
ingly. For example, somatoform constructs 
are not as heavily researched as other 
phenomena on the level of major spectra 
(e.g., internalizing and externalizing), and 
this provides an important opportunity 
for targeted and focused research 44 . Spe¬ 
cifically, how closely do somatoform con¬ 
cepts align with other spectrum concepts, 
and what are the shared and distinguish¬ 
ing features of these concepts? 

Rather than being handled in relatively 
insular literatures aligned with traditional 
classificatory rubrics, the HiTOP frame¬ 
work provides novel opportunities for 
more targeted and synthetic research on 
key empirical questions in classification. 
For example, how do somatoform phe¬ 
nomena covary with other phenomena 
in the HiTOP model? Are they better 
understood as an aspect of the broader 
internalizing spectrum, or are they suffi¬ 
ciently distinguished to form their own 
separate spectrum? If they have both 
shared and distinctive features, are in¬ 


tervention efforts more effective if fo¬ 
cused on the shared features, or on the 
distinctive features? Such questions are 
posed and framed by thinking about so¬ 
matoform phenomena in the context of 
psychopathology broadly, in ways that 
go well beyond a more piecemeal ap¬ 
proach to parsing and conceptualizing 
psychopathology. 

Similar to the situation with the so¬ 
matoform spectrum, other constructs on 
the spectra level have varying volumes 
of associated literature, as well as being 
associated with specific arrangements por¬ 
trayed in Figure 3. Recognizing these hy¬ 
pothesized arrangements provides gen¬ 
erative avenues for novel research. Con¬ 
sider examples pertinent to each of the 
spectra in Figure 3. The thought disorder 
spectrum reflects the close empirical con¬ 
nections among psychotic phenomena 
that have historically been divided be¬ 
tween more dispositional vs. more acute 
manifestations 45,46 . This empirical dis¬ 
tinction thereby becomes a topic for con¬ 
tinuing empirical inquiry, and not an 
issue presumably settled by the unfortu¬ 
nate tradition of studying personality and 
clinical disorders in separate literatures 47 . 

For example, the ICD-11 proposal for 
personality disorders does not encompass 
a psychoticism domain, not because psy¬ 
chotic phenomena are outside of a com¬ 
prehensive multivariate model of mal¬ 
adaptive personality, but rather because 
tradition places them in a different chapter 
within the ICD (and in contrast with the 
DSM, which assigns schizotypal disorder 
primarily to the personality disorders 
chapter, with a secondary assignment as 
part of the schizophrenia spectrum in 
the schizophrenia and other psychotic 
disorders chapter 48 ). Likewise, antisocial 
personality disorder is assigned both to 
the personality disorder and the disrup¬ 
tive, impulse control and conduct dis¬ 
orders chapter. In the HiTOP approach, 
these sorts of fundamental issues be¬ 
come topics for empirical inquiry. 

Similar issues are addressed by the 
two externalizing spectra portrayed in 
Figure 3. The current HiTOP model re¬ 
flects the distinction between the two 
major aspects of externalization: antag¬ 
onism (hurting others intentionally) and 


disinhibition (acting on impulse or in re¬ 
sponse to a current stimulus, with little 
consideration of consequences 49 ). As such, 
it also reflects the ways in which these 
separable aspects are both present in tra¬ 
ditional DSM diagnostic criteria sets. For 
example, DSM-IV defined antisocial per¬ 
sonality disorder, and similar DSM di¬ 
agnostic concepts, represent a mix of 
antagonistic and disinhibited features 50 . 
The HiTOP model posits that separating 
these empirically-based features may re¬ 
sult in greater clarity regarding the classi¬ 
fication of specific phenomena. For ex¬ 
ample, the model posits a closer connec¬ 
tion between substance related disor¬ 
ders and disinhibition than between sub¬ 
stance related disorders and antagonism. 
In addition, the model ties together closely 
aligned externalizing phenomena that are 
spread throughout DSM chapters and var¬ 
ious literatures (e.g., child and adult mani¬ 
festations of basic antagonistic tendencies, 
as well as phenomena such as intermit¬ 
tent explosive disorder). 

Finally, consider the detachment (avoid¬ 
ance of socioemotional engagement) spec¬ 
trum portrayed in Figure 3. Similar to so¬ 
matoform phenomena, detachment phe¬ 
nomena have not been as heavily studied 
as other major spectra. In addition, simi¬ 
lar to externalizing phenomena, detach¬ 
ment has been somewhat diffused through¬ 
out traditional nosologies, being captured 
within the features of a number of tra¬ 
ditional personality disorders. The HiTOP 
model recognizes the evidence that de¬ 
tachment appears to be a major spectrum 
of adult psychopathology. As such, the 
model underlines the importance of un¬ 
derstanding the public health significance 
of pathological socioemotional avoidance, 
as opposed to spreading this feature a- 
cross constructs that have attracted rela¬ 
tively less clinical and research attention, 
compared with more florid manifestations 
of psychopathology. 

Below the level of spectra in Figure 3 
are levels encompassing subfactors and 
disorders. These concepts reflect a mix of 
more traditional and more empirically 
based rubrics. The presence of traditional 
diagnostic labels on Figure 3 is not to reify 
these concepts (many of which are highly 
heterogeneous, and therefore in need of 
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empirical refinement), but rather, to pro¬ 
vide a cross walk to traditional and famil¬ 
iar DSM-style labels. As the model implies, 
the heterogeneity of these phenomena 
provides important opportunities for 
clarifying investigations. 

Consider, for example, borderline per¬ 
sonality disorder (BPD), which is listed 
below both the distress and antagonistic 
externalizing rubrics in the working Hi- 
TOP model. BPD encompasses a number 
of distinguishable elements and, as a re¬ 
sult, tends to be associated with diverse 
psychopathology spectra 51,52 . Indeed, the 
majority of the variance in BPD is shared 
with other forms of psychopathology 
(rather than being unique to it), empha¬ 
sizing the importance of reducing BPD 
and similar constructs to their constitu¬ 
ent elements, and working to reconstitute 
those elements in an empirical manner. 

This type of refinement endeavor has 
been clarifying in specific literatures where 
it has been undertaken. For example, 
empirical efforts underlie large segments 
of the DSM-5 alternative personality dis¬ 
order model, and frame the essential struc¬ 
ture of the ICD-11 personality disorder ap¬ 
proach, in ways that go fundamentally be¬ 
yond traditional personality disorder ru¬ 
brics. Thinking broadly, the HITOP model 
underlines the general utility of this type 
of empirical refinement endeavor, pursued 
with regard to psychopathology writ large. 


THE HIERARCHICAL TAXONOMY 
OF PSYCHOPATHOLOGY 
CONSORTIUM (HiTOP) AS A 
FRAMEWORK FOR CONTINUED 
PROGRESS 

HiTOP is intended to serve as a con¬ 
sortium to organize and stimulate pro¬ 
gress on an empirical approach to classi¬ 
fying psychopathology. To facilitate this 
progress, the consortium is organized 
into a series of workgroups. The work¬ 
group rubrics do not exhaust all the 
important issues that might be addressed 
in empirical psychopathology classifica¬ 
tion. Nevertheless, they do reflect themes 
that have emerged to organize current 
HiTOP efforts. Importantly, membership 


in HiTOP is not closed, and there are 
many opportunities to get involved in 
various aspects of the endeavor 42 . 

Higher-order dimensions workgroup 

A significant challenge posed by the 
model in Figure 3 is its breadth. As im¬ 
plied by the distinction between Figure 2 
and Figure 3 (i.e., the distinction between 
detail and breadth), many empirical 
classification efforts have been under¬ 
standably focused on specific spectra of 
psychopathology. Above the level of 
internalizing in Figure 3 is the "super 
spectra" level, which is currently open, 
largely because relations among various 
psychopathology spectra remains an ac¬ 
tive area of empirical inquiry. For ex¬ 
ample, there has been recent interest in 
a general psychopathology dimension, 
akin to the general dimension found in 
the cognitive abilities literature 53,54 . 

Although there is little doubt that var¬ 
iation in psychopathology spectra is gen¬ 
erally correlated (i.e., multi-morbidity is 
encountered frequently), important issues 
remain to be addressed in contemplating 
the organizational structure of psycho¬ 
pathology above the spectrum level. For 
example, for a hierarchical construct to be 
"truly general", its influence on constructs 
below it in a hierarchy should be relatively 
uniform. Contrary to this conceptualiza¬ 
tion, the magnitude of influence of the 
general psychopathology factor on specif¬ 
ic constructs below it has not been neces¬ 
sarily uniform. For example, Caspi et al 53 
modeled a general factor of psychopa¬ 
thology and found it to be associated pri¬ 
marily with psychotic phenomena. Lahey 
et al 54 also modeled a general factor of 
psychopathology, but found it to be asso¬ 
ciated primarily with phenomena that fall 
generally into the distress subdomain of 
internalizing (albeit they did not specific¬ 
ally study psychotic phenomena). 

These distinctions between various rep¬ 
resentations of the general factor of psy¬ 
chopathology may relate to important 
technical issues surrounding the mean¬ 
ing and interpretation of a general factor. 
For example, technical issues have arisen 


in the literature on individual differences 
in cognitive test performance. In that lit¬ 
erature, it is now understood that ways of 
modeling general factors (e.g., using a 
bifactor versus a hierarchical structural 
model), and ways of comparing models 
(e.g., based on fit indices), differ in subde 
but important ways from many traditional 
approaches to structural modeling 55 57 . 
These issues have yet to be addressed 
thoroughly in the psychopathology litera¬ 
ture, and are therefore a focus of current 
activity in the higher order workgroup. 

Furthermore, we note that the breadth 
of psychopathology in various studies 
of potential general factors is less than 
the breadth of psychopathology encom¬ 
passed in Figure 3. How to efficiendy as¬ 
sess (and thereby have the opportunity to 
model) the entire breadth of psychopa¬ 
thology covered by Figure 3 presents an 
important - and daunting - challenge. In 
addition, the current model does not en¬ 
compass the neurodevelopmental spec¬ 
trum (e.g., intellectual disability, autism 
spectrum disorders, learning disorders), 
the neurocognitive disorders, and the para- 
philic disorders. 

Measures development workgroup 

Many existing measures assess differ¬ 
ent aspects of the HiTOP scheme (see 
https://psychology.unt.edu/hitop ). Nev¬ 
ertheless, as of this writing, a compre¬ 
hensive measure designed to assess the 
entire breadth of psychopathology covered 
in Figure 3 does not exist. The measures 
development workgroup in HiTOP was 
created to address this issue directly. The 
related but distinct goals of the measure¬ 
ment workgroup are to: a) simultaneous¬ 
ly develop measures for all proposed 
symptom dimensions and personality 
traits encompassed by HiTOP in the ser¬ 
vice of empirically refining the model 
through psychometrically rigorous struc¬ 
tural work, and b) based on this work, 
developing clinical useful tools designed 
to permit researchers and mental health 
practitioners to reliably, validly and effi¬ 
ciendy assess all components of the HiTOP 
model. 
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In the service of building clinically 
useful tools, which is an important trans¬ 
lational goal of HiTOP more generally, 
a number of fundamental measurement 
issues arise. We list just a few here to give 
a feel for some of the challenges ahead. 
For example, if the conceptualization of 
psychopathology is dimensional, should 
skip-outs (or other adaptive techniques) 
be employed to enhance the efficiency of 
assessment (akin to skip-outs designed 
on a rational basis to enhance the effi¬ 
ciency of traditional category assessment 
via structured interview)? Traditionally, 
dimensional approaches to psychopa¬ 
thology have been more closely associ¬ 
ated with questionnaire as opposed to 
interview assessment strategies (because 
of the close intellectual and historical con¬ 
nections between psychometrics and 
questionnaire development). How can 
interview approaches - often favored in 
clinical research contexts - be developed 
that reflect more dimensional conceptu¬ 
alizations (e.g., the Structured Interview 
for the Five Factor Model 58 and the Inter¬ 
view for Mood and Anxiety Symptoms 38 )? 
In addition, assessment of traditional cat¬ 
egories via interview is typically modular¬ 
ized; only specific modules are used in 
many assessments, consistent with the 
constructs targeted. Can or should di¬ 
mensional assessment be similarly modu¬ 
larized? Is this even possible or desir¬ 
able, given the evidence portrayed in 
Figure 3, that all varieties of psychopa¬ 
thology are positively correlated? Final¬ 
ly, how can transient symptom mani¬ 
festations and chronic maladaptive trait 
characteristics be seamlessly integrated 
within a single instrument? 

Normal personality workgroup 

The resemblance between the model 
portrayed in Figure 3 and well-established 
models of human personality variation, 
particularly the prominent Five Factor 
Model 59 , is clear. This resemblance is 
not accidental, but rather reflects the ways 
in which personality forms the empirical 
psychological infrastructure for the devel¬ 
opment of specific varieties of psycho- 
pathological symptoms 59 . Nevertheless, 


a number of interesting and important 
issues arise in recognizing the inter¬ 
twined nature of variation in personal¬ 
ity and psychopathology. 

For example, as noted earlier, the mod¬ 
el in Figure 3 reflects empirical connec¬ 
tions based on extant literature that was 
framed by constructs that vary in their 
associated presumed periodicity. By tra¬ 
dition, DSM frames some disorders as 
more episodic (e.g., mood disorders), and 
other disorders are more dispositional 
(e.g., personality disorders). Stepping back 
from this act of historical fiat, what in 
actuality are the distinctions between 
more dispositional personality constructs, 
and more acute symptom constructs? 
Both seem important in comprehensive 
case conceptualization but, practically 
and empirically, what strategies might 
help to parse similarities and differences, 
yet also unify them in a more comprehen¬ 
sive model? These are the sorts of issues 
that fall into the bailiwick of the HiTOP 
normal personality workgroup. 

Utility workgroup 

Implicit in articulating the type of 
model portrayed in Figure 3 is the idea 
that this model has utility, i.e., that it 
can do some useful work in the world 
that will help to propel research and 
clinical practice. The role of the utility 
workgroup is to realize this potential ex¬ 
plicitly. A number of examples might be 
mentioned, but those that seem par¬ 
ticularly salient involve connections of 
empirical psychopathological pheno¬ 
types with neural mechanisms and ge¬ 
nomic variants, given contemporary fund¬ 
ing priorities. The biomedical research 
enterprise (e.g., the basic paradigm 
framing funding bodies such as the US 
National Institutes of Health) prioritizes 
the role of fundamental biological pro¬ 
cesses in addressing issues in public 
health. This prioritization reflects the suc¬ 
cess of this paradigm in addressing many 
health problems during the 20th century. 
Accordingly, there is substantial interest 
and financial investment in understand¬ 
ing the neural bases of manifest psycho¬ 
pathology. 


HiTOP constructs have a key role to 
play in furthering this endeavor. For ex¬ 
ample, the RDoC initiative has some¬ 
times been criticized for providing lim¬ 
ited guidance in conceptualizing clini¬ 
cal psychopathology per se. This may 
in some ways reflect a disjunction be¬ 
tween what RDoC has aimed to achieve, 
and what investigators are seeking. To 
our reading, RDoC aimed to focus atten¬ 
tion and effort on more fundamental 
neurobiological constructs as promising 
topics for research. The intent was not 
necessarily to re-conceptualize pheno¬ 
typic psychopathology 60 . In this way, Hi¬ 
TOP represents a necessary and desirable 
counterpart to RDoC. The interface be¬ 
tween the neurobiological constmcts of 
RDoC and the more phenotypic con¬ 
structs of HiTOP represents a key means 
of connecting structure and process in 
understanding psychopathology. 

Clinical translation workgroup 

Although traditional nosologies are 
framed by their category labels, dimen¬ 
sional approaches to psychopathology 
are also clearly part and parcel of clini¬ 
cal practice. Psychosocial and pharmaco¬ 
logical intervention strategies often are 
effective because they track clinically sa¬ 
lient clusters of symptom dimensions 61 . 
Indeed, dimensional conceptualization and 
corresponding intervention strategies are 
arguably (if not always explicitly) the es¬ 
sence of clinical practice 62 . Triage is often 
a matter of matching the intensity of the 
presentation with the intensity of inter¬ 
vention. In routine clinical practice, the 
key decision is not typically "to treat or 
not to treat". Rather, the key decision is 
“what level of intervention best suits this 
level of need?". 

To pick a specific example, persons 
presenting with substance use problems 
are not clinically homogenous in their 
level of problems and corresponding need 
for a specific treatment approach (indeed, 
the DSM-5's more dimensional conceptu¬ 
alization of substance use disorder reflects 
this reality). Instead, milder presentations 
can often be treated effectively through 
outpatient detoxification (assuming medi- 
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cal stabilization); more severe presentations 
often benefit from more structured ap¬ 
proaches (e.g. ; partial hospitalization); and 
very severe presentations often require at 
least an initial inpatient stay (e.g., for pur¬ 
poses of medical stabilization). As this ex¬ 
ample makes clear, conceptualizing sub¬ 
stance use presentations as "present vs. 
absent" would be fundamentally at odds 
with routine and responsible clinical 
practice 63 . The clinical translation work¬ 
group serves to make these sorts of di¬ 
mensional considerations more explicit, 
and to help disseminate specific dimen¬ 
sionally-oriented approaches to front-line 
clinicians. 


SUMMARY AND CONCLUSIONS 

There has been considerable recent 
interest in empirical approaches to psy¬ 
chopathology classification. This inter¬ 
est has arisen for various reasons, but 
arguably, the overarching consideration 
and motive is to place classification on 
an empirical playing field, as opposed to 
relying more on the political consider¬ 
ations that influence traditional noso¬ 
logical endeavors, such as the DSM revi¬ 
sion process. 

This empirical classification movement 
is well intended, but numerous challenges 
remain. For example, will progress result 
more from a distributed approach, or from 
a more centrally organized approach? In 
many sciences, a distributed approach 
facilitates progress. Laboratories com¬ 
pete for resources, and seek to replicate 
other laboratories' work. Classification 
of psychopathology, however, presents 
different kinds of scientific and practical 
challenges. For example, there is a need 
for coherence in conceptualizing the en¬ 
tire breadth of the subject matter. This 
need is arguably more acute than in 
many more focal scientific endeavors. 
That is, a piecemeal classification would 
have limited utility in portraying the en¬ 
tire picture, and portraying the entire 
picture is a key goal in addressing the 
limitations of extant schemes (e.g., the 
generally piecemeal nature of category- 
driven research efforts). 


The HiTOP Consortium formed as a 
way of addressing this need for breadth 
and coherence, closely tethered to data. 
However, HiTOP, like endeavors before it, 
is a consortium of human clinicians, sci¬ 
entists and scholars, each with their own 
unique perspectives, in addition to theft 
shared goals. Although focused square¬ 
ly on the role of data in adjudicating noso¬ 
logical controversies via its principles 42 , 
how will HiTOP navigate new evidence, 
which, after all, is not self-interpreting? 
We are optimistic that these challenges 
can (and indeed must) be surmounted, 
because moving toward a more empirical 
approach is critical to the ultimate intel¬ 
lectual health and credibility of the field. 

The next phase in the development of 
HiTOP and the broader field of empiri¬ 
cal psychopathology classification may 
prove to be a watershed in arriving at a 
data-based approach to age old ques¬ 
tions in classification, and therefore, a 
system that bridges and unifies both re¬ 
search and clinical practice in mental 
health. 
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